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Abstract. Several variants of the Constraint Satisfaction Problem have 
■ been proposed and investigated in the literature for modelling those sce- 

narios where solutions are associated with some given costs. Within these 
frameworks computing an optimal solution is an NP-hard problem in 
general; yet, when restricted over classes of instances whose constraint 
interactions can be modelled via (nearly-) acyclic graphs, this problem is 
known to be solvable in polynomial time. In this paper, larger classes 
of tractable instances are singled out, by discussing solution approaches 
based on exploiting hypergraph acyclicity and, more generally, structural 
decomposition methods, such as (hyper)tree decompositions. 

1 Introduction 

The Constraint Satisfaction Problem (CSP) is a well-known framework [11] for 
modelling and solving search problems, which received considerably attention in 
the literature due to its applicability in various areas. Informally, a CSP instance 
is defined by singling out the variables of interest, and by listing the allowed 
combinations of values for groups of them, according to the constraints arising 
in the application at hand. The solutions for this instance are the assignments 
of domain values to variables that satisfy all such constraints. Many apparently 
unrelated problems from disparate areas actually turn out to be equivalent to 
the CSP and can be accommodated within the CSP framework. Examples are 
puzzles, conjunctive queries over relational databases, graph colorability, and 
checking whether there is a homomorphism between two finite structures. 

Example 1. Figure 1 shows a combinatorial crossword puzzle (taken from [15]). 
A set of legal words is associated with each horizontal or vertical array of white 
boxes delimited by black boxes. A solution to the puzzle is an assignment of a 
letter to each white box such that to each white array is assigned a word from its 
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Fig. 1. A crossword puzzle, its associated hypergraph H cp , and a hypertree decompo- 
sition of width 2 for Hep. 

set of legal words. This problem can be recast in a CSP by associating a variable 
with each white box, and by defining a constraint for each array of white boxes 
prescribing the legal words that are associated with it. < 

When assignments are associated with some given cost, however, computing 
an arbitrary solution might not be enough. For instance, the crossword puzzle 
in Figure 1 may admit more than one solution, and expert solvers may be asked 
to single out the most difficult ones, such as those solutions that minimize the 
total number of vowels occurring in the used words. In these cases, one is usually 
interested in the corresponding optimization problem of computing the solution 
of minimum cost, whose modeling is accounted for in several variants of the basic 
CSP framework, such as fuzzy, probabilistic, weighted, lexicographic, valued, and 
semiring-based CSPs (see [25,4] and the references therein). 

Since solving CSPs — and the above extensions — is an NP-hard problem, 
much research has been spent to identify restricted classes over which solutions 
can efficiently be computed. In this paper, structural decomposition methods are 
considered [15], which identify tractable classes by exploiting the structure of 
constraint scopes as it can be formalized either as a hypergraph (whose nodes 
correspond to the variables and where each group of variables occurring in some 
constraint induce a hyperedge) or as a suitable binary encoding of such hy- 
pergraph. In particular, we focus on the structural methods based on the no- 
tions of (generalized) hypertree width [18, 19] and treewidth [28]. In both cases, 
the underlying idea is that solutions to CSP instances that are associated with 
acyclic (or nearly-acyclic) structures can efficiently be computed via dynamic 
programming, by incrementally processing the structure according to some of 
its topological orderings. 

As a matter of fact, however, while in the case of classical CSPs deep and 
useful results have been achieved for both graph and hypergraph representa- 
tions, in the case of CSP extensions tailored for optimization problems attention 
was mainly focused on binary encodings and, in particular, on the primal graph 
representation, where nodes correspond to variables and an edge between two 
variables indicates that they are related by some constraint. Discussing whether 
(and how) hypergraph-based structural decomposition techniques in the litera- 
ture can be lifted to such optimization frameworks is the main goal of this paper. 
In particular, we consider three CSP extensions: 
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(1) First, we consider optimization problems where every mapping variable- 
value is associated with a cost, so that the aim is to find an assignment 
satisfying all the constraints and having the minimum total cost. 

(2) Second, we consider the case where costs are associated with the allowed 
combinations of simultaneous values for the variables occurring in the con- 
straint, rather than to individual values. Again, within this setting, we con- 
sider the problem of computing a solution having minimum total cost. 

(3) Finally, we consider a scenario where the CSP instance at hand might not 
admit a solution at all, and where the problem is hence to find the assignment 
minimizing the total number of violated constraints (and, more generally, 
whenever a cost is assigned to each constraint, the assignment minimizing 
the total cost of violated constraints). 

For each of the above settings, the complexity of computing the optimal 
solution is analyzed in this paper, by overviewing some relevant recent research 
and by providing novel results. In particular: 

► We show that optimization problems of kind (1) can be solved in polyno- 
mial time on instances having bounded (generalized) hypertree- width hyper- 
graphs. This result is based on an algorithm recently designed and analyzed 
in the context of combinatorial auctions [13]. 

► We show that even optimization problems of kind (2) are tractable on in- 
stances having bounded (generalized) hypertree-width hypergraphs. Indeed, 
we describe how to transform this kind of instances into equivalent instances 
of kind (1), by preserving their structural properties. 

► We observe that optimization problems of kind (3) remain NP-hard even 
over instances having an associated acyclic hypergraph. However, there is 
also good news: they are shown to be tractable on instances having bounded 
treewidth incidence graph encoding. The latter is a binary encoding of the 
constraint hypergraph with usually better structural features than the primal 
graph encoding (sec, e.g., [15, 22]). Again, proof is via a mapping to case (1). 

Organization. The rest of the paper is organized as follows. Section 2 discusses 
preliminaries on CSPs and structural restrictions, and Section 3 provides an 
overview of the structural decomposition methods based on treewidth and (gen- 
eralized) hypertree width. Results for optimization problems of kind (1) and 
(2) are discussed in Section 4, whereas problems of kind (3) are discussed in 
Section 5. Finally, Section 6 draws our conclusions. 

2 CSPs, Acyclic Instances, and their Desirable Properties 

An instance of a constraint satisfaction problem [11] is a triple I = (Var, U,C), 
where Var is a finite set of variables, U is a finite domain of values, and C = 
{Ci, C2, . . . , C q } is a finite set of constraints. Each constraint C v , for 1 < v < q, 
is a pair (S v ,r v ), where S v C Var is a set of variables called the constraint 
scope, and r v is a set of substitutions (also called tuples) from variables in S v 
to values in U indicating the allowed combinations of simultaneous values for 
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Fig. 2. A hypergraph "Hi, a join tree JT(Hi), the primal graph G(Hi), and the inci- 
dence graph inc(Hi). 



the variables in 5„. Any substitution from a set of variables V C Var to [7 is 
extensively denoted as the set of pairs of the form X/u, where u £ U is the value 
to which X £ V is mapped. Then, a solution to I is a substitution 9 : Var i-> J7 
for which q-tuples ii G r\, ...,t q £ r q exist such that = U ... U t q . 

Example 2. In the crossword puzzle of Figure 1, Var coincides with the letters of 
the alphabet, and a variable Xj (denoted by its index i) is associated with each 
white box. An example of constraint is Cm = ((1, 2, 3, 4, 5), vm), and a pos- 
sible instance for rm is {{h, o, it, s, e), (c, o, i, n, s), (b, I, o, c, fc}} — in the various 
constraint names, subscripts H and V stand for "Horizontal" and "Vertical," 
respectively, resembling the usual naming of definitions in crossword puzzles. < 

The structure of a CSP instance I is best represented by its associated hy- 
pergraph H(T) = {V,H), where V = Var and H = {S \ (S,r) £ C}— in the 
following, V and H will be denoted by N(H) and £(H), respectively. As an 
example, the hypergraph associated with the crossword puzzle formalized above 
is illustrated in the central part of Figure 1. 

A hypergraph % is acyclic iff it has a join tree [3]. A join tree JT{'H) for 
a hypergraph % is a tree whose vertices are the hyperedges of TL such that, 
whenever the same node X £ V occurs in two hyperedges hi and of TL, then 
X occurs in each vertex on the unique path linking h\ and hi in JT(T-L). The 
notion of acyclicity we use here is the most general one known in the literature, 
coinciding with a-acyclicity according to Fagin [9]. Note that the hypergraph 
Tlcp of Figure 1 is not acyclic. An acyclic hypergraph is discussed below. 

Example 3. Consider the hypergraph TLi shown on the left of Figure 2, which is 
associated with a CSP instance over the set of variables {A, M}. In particular, 
six constraints are denned over the instance whose scopes precisely correspond 
to the hyperedges in £(Hi); for instance, {A, B, C} is an example of constraint 
scope. Note also that Hi is acyclic. Indeed, a join tree JT(Hi) for it is reported 
in the same figure to the right of Hi- <J 

An important property of acyclic instances is that they can efficiently be 
processed by dynamic programming. Indeed, according to Yannakakis' algo- 
rithm [34] (originally conceived in the equivalent context of evaluating acyclic 
Boolean conjunctive queries), they can be evaluated by processing any of their 
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join trees bottom-up, by performing upward semijoins between the constraint re- 
lations, thus keeping the size of the intermediate result small. At the end, if the 
constraint relation associated with the root atom of the join tree is not empty, 
then the CSP instance does admit a solution. Therefore, the whole procedure 
is feasible in 0(n x r max x logr max ), where n is the number of constraints and 
r max denotes the size of the largest constraint relation. 

In addition to the polynomial time algorithm for deciding whether a CSP 
admits a solution, acyclic instances enjoy further desirable properties: 

Acyclicity is efficiently recognizable: Deciding whether a hypergraph is 
acyclic is feasible in linear time [31] and belongs to the class L (determinis- 
tic logspace). Indeed, this follows from the fact that hypergraph acyclicity 
belongs to SL [16], and that SL is equal to L [27]. 

Acyclic instances can be efficiently solved: After the bottom-up step de- 
scribed above, one can perform the reverse top-down step by filtering each 
child vertex from those tuples that do not match with its parent tuples. 
The relations obtained after the top-down step enjoy the global consistency 
property, i.e., they contain only tuples whose values are part of some solu- 
tion of the CSP. Then, all solutions can be computed with a backtrack-free 
procedure, and thus in total polynomial time, i.e., in time polynomial in the 
input plus the output [34] (and actually also with polynomial delay). Al- 
ternatively, one may enforce pairwise consistency by taking the semijoins 
between all pairs of relations until a fixpoint is reached. Indeed, acyclic in- 
stances that fulfil this property also fulfil the global consistency property 
[2]- 

Acyclic instances are parallelizable: It has been shown that solving acyclic 
CSP instances is highly parallelizable, as this problem (actually, decid- 
ing the existence of a solution) is complete for the low complexity class 
LOGCFL [16]. Efficient parallel algorithms are discussed in [16] and [17]. 

We conclude this section by recalling that the above desirable properties 
of acyclic CSP instances have profitably been exploited in various application 
scenarios. Indeed, besides their application in the context of Database Theory, 
they found applications in Game Theory [14, 8], Knowledge Representation and 
Reasoning [21], and Electronic Commerce [13], just to name a few. 

3 Generalizing acyclicity 

Many attempts have been made in the literature for extending the good results 
about acyclic instances to relevant classes of nearly acyclic structures. We call 
these techniques structural decomposition methods, because they are based on 
the "acyclicization" of cyclic (hyper)graphs. We refer the interested reader to 
[29] for a detailed description of how these techniques may be useful for con- 
straint satisfaction problems and to [22] for further results about graph-based 
techniques, when relational structures are represented according to various graph 
representations (primal graph, dual graph, incidence-graph encoding). We also 
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want to mention recent methods such as Spread-cuts [7] and fractional hypertree 
decompositions [23]. 

A survey of most of these techniques is currently available in Wikipedia (look 
for "decomposition method", at http://www.wikipedia.org). In the sequel, we 
shall briefly overview the tree and hypertree decomposition methods. 

3.1 Tree Decompositions 

For classes of instances having only binary constraints or, more generally, con- 
straints whose scopes have a fixed maximum arity, the most powerful structural 
method is based on the notion of treewidth. 

Definition 1 ([28]). A tree decomposition of a graph G = (V,E) is a pair 
(T, x), where T = (N,F) is a tree, and \ is a labelling function assigning with 
each vertex p e N a set of vertices \{p) Q V sucn that the following conditions 
are satisfied: (1) for each node b of G, there exists p 6 N such that b G x{p): (2) 
for each edge (b, d) £ E, there exists p G N such that {b, d} C x(p)\ an d, (3) for 
each node b of G, the set {p G N \ b <G x(p)} induces a connected subtree of T 
(connectedness condition). The widthoi (T,x) is the number max pe jv(|x(p)| — 1). 
The treewidth of G, denoted by tw(G), is the minimum width over all its tree 
decompositions. □ 

It is well-known that a graph G is acyclic if and only if tw(G) = 1. Moreover, 
for any fixed natural number k > 0, deciding whether tw(G) < k is feasible in 
linear time [5]. 

Any CSP with primal graph G such that tw(G) < k can be (efficiently) 
turned into an equivalent CSP whose primal graph is acyclic. Let I = ( Var, U, C) 
be a CSP instance, let G be the primal graph of H(T), and let (T,x) be a 
tree decomposition of G having width k. We may build a new acyclic CSP 
instance I' = (Var, U,C) over the same variables and universe as I, but with 
a different set of constraints C, as follows. Firstly, for each vertex v of T, we 
create a constraint (S v ,r v ), where S v — x( v ) an d r v = U^ v ^. Then, for every 
constraint (S, r) £ C of the original problem such that S C x(w), we eliminate 
from r v all those tuples that do not match with r. The resulting constraint is 
then added to C. It can be shown that I' has the same solutions as I, and that 
it is acyclic. In fact, observe that, by construction, (T, x) is a join tree of the 
hypergraph "H(I') associated with X', because of the connectedness condition 
of tree decompositions. Furthermore, building I 1 from T is feasible in 0(n x 
|[/| fe+1 ) where n is the number of vertices in T, and where the size of the largest 
constraint relation in the resulting instance is |J7| fc+1 . Since one can always 
consider only tree decompositions whose number of vertices is bounded by the 
number of variables of the problem (i.e., the nodes of the graph), it follows that 
deciding whether T (and hence I) is satisfiable is feasible in 0(|Far| x |J7| fe+1 x 
log \U\ k+1 ). In fact, as for acyclic instances, even in this case we may compute 
also solutions for I with a backtrack-free search, after the preprocessing of the 
instance performed according to the given tree decomposition (i.e., according to 
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the join tree of the equivalent acyclic instance). As a consequence, all classes of 
CSP instances (with primal graphs) having bounded treewidth may be solved 
in polynomial time, even if with an exponential dependency on the treewidth. 

Clearly enough, this technique is not very useful for CSP instances with 
large constraint scopes. In particular, the class of CSP instances whose asso- 
ciated constraint hypergraphs are acyclic are not tractable according to tree 
decompositions, because acyclic hypergraphs may have unbounded treewidth. 
Intuitively, in the primal graph all variables occurring in the same constraint 
scope are connected to each other, and thus they lead to a clique in the graph. 
It follows that CSP instances having constraint scopes with large arities have 
large treewidths, too, because the treewidth of a clique of n nodes is n — 1. As 
an example, Figure 2 reports the graph G{J-L\) associated with the acyclic hy- 
pergraph Hi, where one may notice how the hyperedge {A, C, D, E, F, G, H} is 
flattened into a clique over all its variables. 

3.2 Hypertree Decompositions 

Let us now turn our attention to hypergraph based decompositions. Such decom- 
positions are similar to tree decompositions, but they use an additional covering 
of each set x(p) with as few as possible hyperedges. The width is then no longer 
defined as the maximum cardinality of x(p) over all decomposition nodes p, but 
as the maximum number of hyperedges used to cover x(p)- Intuitively, this no- 
tion of width is better, because it will allow us to expresses more accurately the 
computational effort needed to transform an instance into an acyclic one. 

Definition 2 ([19]). A generalized hypertree decomposition of a hypergraph H 
is a triple HD = (T, x, A), where (T, \) is a tree decomposition of the primal 
graph of H, and A is a labelling of the tree T by sets of hyperedges of % such 
that, for each vertex p e vertices(T) 7 x(p) Q iJheXM ^- That is, all variables in 
the x labeling are covered by hyperedges (scopes) in the A labeling. The width 
of HD is the number max peueT . tices ( T )(|A(p)|). The generalized hypertree width of 
*H, denoted by ghw(H) 7 is the minimum width over all its generalized hypertree 
decompositions. If I is a CSP instance then ghw(I) := ghw(H(I)). □ 

Clearly, for each CSP instance /, ghw(I) < tw(I). Moreover, there are 
classes of CSPs having unbounded treewidth whose generalized hypertree width 
is bounded [19]. 

Finding a suitable tree decomposition whose sets x(p) may each be covered 
with a few hyperedges seems to be quite a hard task even in case we have some 
fixed upper bound k. Indeed, it has been shown that deciding whether ghw(H) < 
k is NP-complete (for any fixed k > 3) [20]. Fortunately, since its first proposal in 
[18], this notion comes with a tractable variant, called hypertree decomposition, 
whose associated width is at most 3 times (+1) larger than the generalized 
hypertree width [1]. As a consequence, it can be shown that every class of CSPs 
that is tractable according to generalized hypertree width is tractable according 
to hypertree width, as well. 
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Definition 3 ([18]). A hypertree decomposition of a hypergraph H is a gen- 
eralized hypertree decomposition HD = (T, \, A) that satisfies the following 
additional condition, called Descendant Condition or also special condition: 
Vp G vertices(T), V/i G A(p), ft, n x(T p ) C x(p), where T p denotes the sub- 
tree of T rooted at p, and x(T p ) the set of all variables occurring in the \ 
labeling of this subtree. 

The hypertree width hw(H) of % is the minimum width over all its hypertree 
decompositions. □ 

As an example, on the right part of Figure 1 a hypertree decomposition of 
the hypergraph % cp in Example 1 is reported. Note that this decomposition has 
width 2. 

We refer the interested reader to [18, 29] for more details about this notion 
and in particular about the descendant condition. Here, we just observe that the 
notions of hypertree width and generalized hypertree width are true generaliza- 
tions of acyclicity, as the acyclic hypergraphs are precisely those hypergraphs 
having hypertree width and generalized hypertree width one. In particular, the 
classes of CSP instances having bounded (generalized) hypertree width have the 
same desirable computational properties as acyclic CSPs [16]. Indeed, from a 
CSP instance I = ( Var, U, C) and a (generalized) hypertree decomposition HD 
of %{!) of width k, we may build an acyclic CSP instance X' = ( Var, U, C) with 
the same solutions as I. The overall cost of deciding whether I is satisfiable is in 
this case 0((?n— 1) x r^ nax x 

^-°S r max)i where r max denotes the size of the largest 
constraint relation and m is the number of vertices of the decomposition tree, 
with m < | Var\ (in that we may always find decompositions in a suitable normal 
form without redundancies, so that the number of vertices in the tree cannot 
exceed the number of variables of the given instance). To be complete, if the in- 
put consists of X only, we have to compute the decomposition, too. This can be 
done with a guaranteed polynomial-time upper bound in the case of hypertree 
decompositions [18]. 

In the following two sections, we provide some tractability results for op- 
timization problems. For the sake of presentation, we give algorithms for the 
acyclic case, provided that these results may be clearly extended to any class of 
instances having bounded (generalized) hypertree width, after the above men- 
tioned polynomial-time transformation. 

4 Optimization Problems over CSP Solutions 

In this section, we consider optimization problems where an assignment has to 
be singled out that satisfies all the constraints of the underlying CSP instance 
and that has minimum total cost; in other words, we look for a "best" solution 
among all the possible solutions. In particular, below, we shall firstly address the 
case where each possible variable- value mapping is associated with a cost (also 
called constraint satisfaction optimization problem); then we shall consider the 
case where costs are defined over the constraints tuples (weighted CSP). 
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Input: An acyclic CSOP instance <Z, w) with X = (Var, U, C) , C = {(Si , n ),..., (5 g , r g ) }, 


and a join tree T — (TV, i?) of the hypcrgraph "H(X): 


Output: A solution to (X,w): 




var t* : Var i— > (7; 




£^ : : rational number, for each tuple t v G r v ; 


tt v> c '■ tuple in r c , for each tuple t v £ r„, and for each (v. c) £ -E; 


Procedure BottomUp; 




begin 




Done :— the set of all the leaves of T; 


while 3v £ T such that (i) u Done, and (ii) {c c is child of t?} C Done do 


r v := r v - {t v | c) e E such that Vi c £ C , i v 56 i c }; 


if r w = then EXIT; (* X is 


not satisfiable *) 


for each t v £ r v do 


:=tu(t„); 




for each c such that (v, c) £ E do 


t c := argmin tcGrc | tii ^ tc 


t c tc -w(t c nt v )) ; 


t tv c :— t c ; (* set best solution *) 


— +e { -w(i c nt v ); 


end for 




end for 




Done :— Done U {v}; 




end while 




end; 




begin (* MAIN *) 


Procedure TopDown(v : vertex of TV, t v £ r v ); 


BottomUp; 


begin 


let r be the root of T; 


for each c £ AT s.t. (v, c) £ J5* do 


t r := argmin trGrr ^ ; 


tc := tt WlC ;_ 


t* :— t r ; (* include solution *) 


t* :— t* U £ c ; (* include solution *) 


TopDown(r, t r ); 


TopDown{c, t c )', 


return t* ; 


end for 


end. 


end; 



Fig. 3. Algorithm ComputeOptimalSolution. 



4.1 Constraint Satisfaction Optimization Problems 

An instance of a constraint satisfaction optimization problem (CSOP) con- 
sists of a pair (X,w), where X = (Var,U,C) is a CSP instance and where 
w : Var x U i-> Q is a function mapping substitutions for individual vari- 
ables to rational numbers. For a substitution {Xi/ui, X n /u n }, we denote by 
w;({Xl/ui, X n /u n }) the value X)ILi w {Xu u i)- Then, a solution to a CSOP 
instance (I, w) is a solution 9 to X such that u>(0) < w(0'), for each solution 9' 
to I. Details on this framework can be found, e.g., in [32]. 

Constraint satisfaction optimization problems naturally arise in various ap- 
plication contexts. As an example they have recently been used in the context 
of combinatorial auctions [13], in order to model and solve the winner deter- 
mination problem of determining the allocation of the items among the bidders 
that maximizes the sum of the accepted bid prices. In particular, in [13], it has 
been observed that CSOPs and, in particular, the winner determination prob- 
lem, can be solved in polynomial time on some classes of acyclic instances via a 
dynamic programming algorithm founded on the ideas of [34]. This algorithm, 
named ComputeOptimalSolution, is reported in Figure 3 and will be briefly 
illustrated in the following. 
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The algorithm receives in input the instance (1, w) and a join tree T = (N, E) 
for rl(X). Recall that each vertex v G N corresponds to a hyperedge of H(X) 
and, in its turn, to a constraint in C; hence, we shall simply denote by (S v ,r v ) 
the constraint in C univocally associated with vertex v. 

Based on (I, w) and T, ComputeOptimalSolution computes an optimal 
solution (or checks that there is no solution) by looking for the "conformance" of 
the tuples in each relation r v with the tuples in r c , for each child c of v in T, where 
t v G r v is said to conform with t c G r c , denoted by t„ « t c , if for each X G S v CiS c , 
X/u g t v <^ X/u G t c . In more detail, ComputeOptimalSolution solves 
(X, w) by traversing T in two phases. First, vertices of T are processed from 
the leaves to the root r, by means of the procedure BottomUp that updates 
the weight of the current vertex v. Intuitively, t% stores the cost of the best 
partial solution for X computed by using only the variables occurring in the 
subtree rooted at v. Indeed, if v is a leaf, then t\ = w(t v ). Otherwise, for each 
child c of v in T, is updated by adding the minimum value l\ — w(t c Dt v ) 
over all tuples t c conforming with t v . The tuple t c for which this minimum is 
achieved is stored in the variable tt^,c (resolving ties arbitrarily). Note that if 
this process cannot be completed, because there is no tuple in r v conforming 
with some tuple in each relation associated with the children of v, then we may 
conclude that I is not does not admit any solution. Otherwise, after the root 
reJVis reached, this part ends, and the top-down phase may start. 

In this second phase, the tree T is processed starting from the root. Firstly, 
the assignment t* is defined as the tuple in r r with the minimum cost over all 
the tuples in r r (again, resolving ties arbitrarily). Then, procedure TopDown 
extends t* with a tuple for each vertex of T: at each vertex v and for each child 
c of v, t* is extended with the tuple t tv . c resulting from the bottom- up phase. 

Being based on a standard dynamic programming scheme, correctness of 
ComputeOptimalSolution can be shown by structural induction on the sub- 
trees of T [13]. Moreover, by analyzing its running time, one may note that deal- 
ing with cost functions does not (asymptotically) provide any overhead w.r.t. 
Yannakakis's algorithm [34] for plain CSPs. Following [13], the following can be 
shown for the more general case of CSOP instances having bounded generalized 
hypertree- width hypergraphs. 1 

Theorem 1. Let (l,w) be a CSOP instance and HD a (generalized) hypertree 
decomposition ofH(T). Moreover, let k be the width of HD andm be the number 
of vertices in its decomposition tree. Then, a solution to (J, w) can be computed 
(or it is discovered that no solution exists) in time 0{(m — 1) x r^ nax x logr^ oa .), 
where r max is the size of the largest constraint relation in X. 

1 In all complexity results, we assume the weighting function w be explicitly listed in 
the input (otherwise, just add the cost of computing through w all cost values for 
the variable assignments of the given input instance). 
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4.2 Weighted CSPs: Costs over Tuples 

Let us now turn to study a slight variation of the above scenario, where costs 
are associated with each tuple of the constraint relations, rather than with sub- 
stitutions for individual variables. In fact, this is the setting of weighted CSPs, 
a well-known specialization of the more general valued CSP framework [30]. 

Formally, a weighted CSP (WCSP) instance consists of a tuple (I, w\, w q ), 
where X — ( Var, U, C) with C — {C\, C2, ■ ■ ■ , C q } is a CSP instance, and where, 
for each tuple t v £ r v , w v (t v ) £ Q denotes the cost associated with t v . For a 
solution 9 = tiU...Uig to X, wc define w(9) — J2l=i w v(t v ) as its associated cost. 
Then, a solution to (I, w\, w q ) is a solution 9 to X such that w{9) < w(9'), 
for each solution 9' to X. 

A few tractability results for WCSPs (actually, for valued CSPs) are known in 
the literature when structural restrictions are considered over binary encodings 
of the constraint hypergraphs. Indeed, it has been observed that WCSPs are 
tractable when restricted on classes of instances whose associated primal graphs 
are acyclic or nearly-acyclic (see, e.g., [33,10,26]). However, the primal graph 
obscures much of the structure of the underlying hypergraph since, for instance, 
each hyperedge is turned into a clique there — see the discussion in Section 3. 

Therefore, whenever constraints have large arities, tractability results for pri- 
mal graphs are useless, and it becomes then natural to ask whether polynomial- 
time solvability still holds when moving from (nearly-)acyclic primal graphs 
to acyclic hypergraphs, possibly associated with very intricate primal graphs. 
Next, we shall positively answer this question, by simply recasting weighted 
CSPs as constraint optimization problems, and by subsequently solving them 
via the algorithm ComputeOptimalSolution. To this end, given a WCSP 
instance (I, w\, w q ), we define its associated CSOP instance, denoted by 
CSOP((X,u;i, w q )), as the pair (X',w') with X' = (Var',U',C) such that: 

• Var' = Var U {D\, D q }, where each D v is a fresh auxiliary variable in I'; 

• U' — UL){Jl =1 Ut er ,{ u t„}: i- c -i f° r eacn constraint (S v , r v ) £ C, V contains 
a fresh value for each tuple in r v — intuitively, mapping the variable D v to 
Ut„ encodes that the tuple t v is going to contribute to a solution for I; 

• C = {(S v U {D v },r' v ) I {S v ,r v ) £ C}, where r' v = {t v U {D v /u tv } \ t v £ r v }; 

• w'(X/u) = w v (t v ) if X — D v and u = Ut v , for some tuple t v £ r v ; otherwise, 
w'(X/u) — 0. That is, the whole cost of each tuple is determined by the 
mapping of its associated fresh variable D v . 

It is immediate to check that the above transformation is feasible in linear 
time. In addition, the transformation enjoys two relevant preservation properties: 
Firstly, it preserves the structural properties of the WCSP instance in that ~H(X') 
is acyclic if and only if H(P) is acyclic; and secondly, it preserves its solutions, in 
that 9' = t[ U ... Lit' q is a solution to (I, w\, w q ) if and only if 6 = t\ U ... Ut q is 
a solution to (X 1 , w'), where t' v = t v U {D v /u t J\ for each 1 < v < q. By exploiting 
these observations and Theorem 1, the following can be established. 

Theorem 2. Let (X, w\, w q ) be a WCSP instance and HD a (generalized) 
hypertree decomposition ofH(X). Moreover, let k be the width of HD and m be the 
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number of vertices in its decomposition tree. Then, a solution to (I, wi, w q ) 
can be computed (or we may state that there is no solution) in time 0((m—\) x 
r max x \°g r max)> where r max is the size of the largest constraint relation in X. 

5 Minimizing the Number of Violated Constraints 

In this section, we shall complete our picture by considering those scenarios 
where problems might possibly be overconstrained and where, hence, the focus is 
on finding assignment minimizing the total number of violated constraints. These 
kinds of problems are usually referred to in the literature as Max-CSPs [12], 
which similarly as WCSPs are specializations of valued CSPs. 

Formally, let 9 : Var M> [/ be an assignment for a CSP instance X = 
( Var, U, C). We say that the violation degree of 9, denoted by 6(9), is the number 
of relations r v such that there is no tuple t v <E r v with t v C 9. An assignment 
9 : Var n> U is a solution to the Max-CSP instance (associated with X) if 
8(9) < 6(9'), for each assignment 9' : Var h-> U . Note that Max-CSPs instances, 
by definition, do always have a solution. 

5.1 Acyclic Instances Remain Intractable 

After the tractability results established in Section 4.2 for WCSPs, one may 
expect good news for Max-CSPs, too. Surprisingly, this is not the case. 

Theorem 3. Solving Max-CSPs is NP-hard, even when restricted over classes 
of instances with acyclic constraint hypergraphs. 

Proof. Consider any class T of CSPs instances having an NP-hard satisfiability 
problem. Then, let T' be a new class of Max-CSP instances such that, for each 
X = ( Var, U, C) G T, V contains an instance X' = ( Var, U, C) with C = C U 
{( Var, 0)}. That is, any instance X 1 £ T' has a constraint over all variables with 
an empty constraint relation, and thus it is not satisfiable. Moreover, because 
of the big hyperedge associated with such a constraint, its hypergraph T-L(I') is 
trivially acyclic. Also, by construction, there is an assignment for X' violating 
only one constraint if and only if X is satisfiable. It follows that finding an 
assignment minimizing the total number of violated constraints is NP-hard on 
the class of acyclic instances T' ■ □ 

5.2 Incidence graphs and Tractable Cases 

Given that hypergraph acyclicity and hence its generalizations are not sufficient 
for guaranteeing the tractability of Max-CSPs, it makes sense to explore acyclic- 
ity properties related to suitable graph representations. In fact, as observed in 
Section 4.2, it is well-known that valued CSPs (and, hence, Max-CSPs) are 
tractable over acyclic primal graphs (e.g., [33, 10,26]). More precisely, tractabil- 
ity has been observed in the literature to hold over primal graphs having bounded 
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treewidth (see Section 3). Our main result in this section is precisely to show that 
tractability still holds in case the incidence graph of H(X) has bounded treewidth, 
which is a more general condition than the bounded treewidth of primal graphs 
and which can be used to establish better complexity bounds and to enlarge the 
class of tractable instances [22] . The fact that the standard CSP is tractable for 
instances whose incidence graphs have bounded treewidth was already shown 
in [6]. We here extend this tractability result to Max-CSPs. 

Recall that the incidence encoding of a hypergraph "H, denoted by inc(H) = 
(N, E), is the bipartite graph where N = £{H) U N(U) and E = { {h, a} \ h e 
£(H) and a e h)}, i.e. it contains an edge between h and a if and only if the 
variable a occurs in the hyperedge h. As an example, Figure 2 reports on the 
rightmost part the incidence graph inc(Hi), where nodes associated with hyper- 
edges in £{%\) are depicted as black circles. Note that the treewidth of mc(Hi) 
is 2, which is much smaller than the treewidth of G(Hi). This does not happen 
by chance since, for each hypergraph H, it holds that tw(inc(H)) < tw(G(H)); 
in addition, there are also classes of hypergraphs with incidence encodings of 
bounded treewidth and primal encodings of unbounded treewdith (see, e.g., [22]). 

While enlarging the class of instances having bounded treewidth, the in- 
cidence encoding still conveys all the information needed to solve Max-CSP 
instances. Again, the solution algorithm consists of a transformation into a suit- 
able CSOP instance. Formally, let X = ( Var, U, C) be a Max-CSP instance with 
C = {(S\,n), ...,(S q ,r q )}, and let (T,x) be a fc-width tree decomposition of 
inc{T-L(X)) — recall that for each vertex v £ T, \(v) is a set of variables (i.e., nodes 
of N(H(X))) and constraint scopes (i..e, edges in £{%(!))). Then, the constraint 
satisfaction optimization problem instance CSOP(X, (T,x)) is the pair (X',w'), 
where X' = ( Var' , U', C) and such that: 

• Var' = Var U {Si, S q }, that is, also the constraint scopes of C belong to 
the variables of the new problem; 

• U' = U U {unsat} U {ut \ t G n, for 1 < i < q}: 

• C' = {(x( v )> r v) I v ^ T} where the constraint relation r' v is defined as 
follows. Let ii — \x(v) fl Var |, and let denote the set of all possible tuples 
over the \i variables in \{ v ) H Var. Let also Si 17 ...Si h be the scope-variables 
in x( v )- Then, for each tuple 9 e U^, the relation r' v contains all tuples 
9 U {Si 1 /v il } U • • • U {Si h /v ih }, where Vi j € U (1 < j < h) is a value for the 
scope- variable such that: v ij = u t if there is a tuple t £ r ij conforming 
with 9; and — unsat, if no such a tuple exists in rv . 

• w'(X/u) — if u ^ unsat; otherwise w'(X/u) = 1, that is, each constraint 
of C that is not satisfied increases the cost of a solution by a unitary factor. 

Note that this transformation is feasible in time exponential in the width of 
(T, x) only. Moreover, solutions of X' with minimum total cost precisely corre- 
spond to assignments over X minimizing the total number of violated constraints. 
In fact, the following can be established. 

Theorem 4. Let! = (Var, U,C) be a Max-CSP instance with tw(inc(H(X))) = 
k. Then, a solution to X can be computed in time 0( \ Var\ x\U\ k+1 x log \ U\ k+1 ). 
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6 Conclusion and Discussion 

In this paper, classes of tractable CSOP, WCSP, and Max-CSP instances are 
singled out by overviewing and proposing solution approaches applicable to 
instances whose hypergraphs have bounded (generalized) hypertree width, or 
whose incidence graphs have bounded treewidth. The techniques described in 
this paper arc mainly based on Algorithm ComputeOptimalSolution, which 
has been designed to optimize costs expressed as rational numbers and combined 
via the summation operation. However, it is easily seen that it remains correct 
if costs are specified over an arbitrary totally ordered monoid structure, where 
some binary operation © (in place of standard summation) is used in order to 
combine costs, provided it is commutative, associative, closed, and that it ver- 
ifies identity and monotonicity. It follows that all tractable classes of CSOP, 
WCSP, and Max-CSP instances identified in this paper remain tractable in such 
extended scenarios, which indeed emerge with valued CSPs (see, e.g., [4]). 

References 

1. I. Adlcr, G. Gottlob, and M. Grohe. Hypertree-Width and Related Hypergraph 
Invariants. European Journal of Combinatorics, 28, pp. 2167-2181, 2007. 

2. C. Beeri, R. Fagin, D. Maier, and M. Yannakakis. On the desirability of acyclic 
database schemes. Journal of the ACM, 30(3), pp. 479-513, 1983. 

3. P.A. Bernstein and N. Goodman. The power of natural semijoins. SIAM Journal 
on Computing, 10(4), pp. 751-771, 1981. 

4. S.Bistarelli, U. Montanari, F. Rossi, T. Schiex, G. Verfaillie, and H. Fargier. 
Semiring-Based CSPs and Valued CSPs: Frameworks, Properties, and Comparison. 
Constraints, 4(3), pp. 199-240, 1999. 

5. H.L. Bodlaender and F.V. Fomin. A Linear-Time Algorithm for Finding Tree 
Decompositions of Small Treewidth. SIAM Journal on Computing, 25(6), pp. 
1305-1317, 1996. 

6. Ch. Chekuri and A. Rajaraman. Conjunctive Query Containment Revisited. The- 
oretical Computer Science Vol. 239, Issue 2, 28 May 2000, pp. 211-229, 2000. (Pre- 
liminary version in Proc. ICDT'07.) 

In Proc. International Conference on Database Theory 1997 (ICDT'97), Delphi, 
Greece, Jan. 1997, Springer LNCS, Vol. 1186, pp. 56-70, 1997. Full version: 

7. D.A. Cohen, P.G. Jeavons, and M. Gyssens. A unified theory of structural tractabil- 
ity for constraint satisfaction problems. Journal of Computer and System Sciences, 
74(5):721-743, 2008. 

8. C. Daskalakis and C.H. Papadimitriou. Computing pure nash equilibria in graph- 
ical games via markov random fields. In Proc. of ACM EC '06, pp. 91-99, 2006. 

9. R. Fagin. Degrees of acyclicity for hypergraphs and relational database schemes. 
J. ACM, 30(3):514-550, 1983. 

10. S. de Givry, T. Schiex, and G. Verfaillie. Exploiting Tree Decomposition and Soft 
Local Consistency In Weighted CSP. In Proc. of AAAI'06, 2006. 

11. R. Dechter. Constraint Processing. Morgan Kaufmann, 2003. 

12. E.C. Freuder and R.J. Wallace. Partial Constraint Satisfaction. Artificial Intelli- 
gence, 58(1-3), pp. 21-70, 1992. 



14 



13. G. Gottlob and G. Greco. On the complexity of combinatorial auctions: structured 
item graphs and hypertree decomposition. In Proc. EC'01, pp. 152-161, 2007. [full 
version currently available as Technical Report, University of Calabria] 

14. G. Gottlob, G. Greco, and F. Scarcello. Pure Nash Equilibria: Hard and Easy 
Games. Journal of Artificial Intelligence Research, 24, pp. 357-406, 2005. 

15. G. Gottlob, N. Leone, and F. Scarcello. A comparison of structural CSP decom- 
position methods. Artificial Intelligence, 124(2), pp. 243-282, 2000. 

16. G. Gottlob, N. Leone, and F. Scarcello. The complexity of acyclic conjunctive 
queries. Journal of the ACM, 48(3), pp. 431-498, 2001. 

17. G. Gottlob, N. Leone, and F. Scarcello. Advanced parallel algorithms for processing 
acyclic conjunctive queries, rules, and constraints. In Proc. of SEKE'00, pp. 167- 
176, 2000. 

18. G. Gottlob, N. Leone, and F. Scarcello. Hypertree decompositions and tractable 
queries. J. of Computer and System Sciences, 64(3), pp. 579-627, 2002. 

19. G. Gottlob, N. Leone, and F. Scarcello. Robbers, marshals, and guards: game 
theoretic and logical characterizations of hypertree width. J. of Computer and 
System Sciences, 66(4), pp. 775-808, 2003. 

20. G. Gottlob, Z. Miklos, and T. Schwentick. Generalized hypertree decompositions: 
NP-hardness and tractable variants. In Proc. of PODS '07, pp. 13-22, 2007. 

21. G. Gottlob, R. Pichler, and F. Wei. Bounded Treewidth as a Key to Tractability 
of Knowledge Representation and Reasoning. In Proc. of AAAI'06. 

22. G. Greco and F. Scarcello. Non-Binary Constraints and Optimal Dual-Graph 
Representations. In Proc. of IJCAI'03, pp. 227-232, 2003. 

23. M. Grohe and D. Marx. Constraint solving via fractional edge covers. In Proc. of 
SODA '06, pp. 289-298, Miami, Florida, USA, 2006. 

24. K. Kask, R. Dechter, J. Larrosa, and A. Dechter. Unifying tree decompositions for 
reasoning in graphical models. Artificial Intelligence, 166(1-2), pp. 165-193, 2005. 

25. P. Meseguer, F. Rossi and T. Schiex. Soft Constraints. Handbook of Constraint 
Programming, Elsevier, 2006. 

26. S. Ndiaye, P. Jgou, and C. Terrioux. Extending to Soft and Preference Constraints 
a Framework for Solving Efficiently Structured Problems. In Proc. of ICTAI'08, 
pp. 299-306, 2008. 

27. O. Reingold. Undirected ST-connectivity in log-space, Journal of the ACM, 55(4), 
2008. 

28. N. Robertson and P.D. Seymour. Graph minors III: Planar tree-width. Journal of 
Combinatorial Theory, Series B, 36, pp. 49-64, 1984. 

29. F. Scarcello, G. Gottlob, and G. Greco. Uniform Constraint Satisfaction Problems 
and Database Theory. In Complexity of Constraints, LNCS 5250, pp. 156-195, 
Springer- Verlag, 2008. 

30. T. Schiex, H. Fargier, and G. Verfaillie. Valued Constraint Satisfaction Problems: 
Hard and Easy Problems. In Proc. of IJCAI'95, pp. 631-639, 1995. 

31. R.E. Tarjan, and M. Yannakakis. Simple linear-time algorithms to test chordality of 
graphs, test acyclicity of hypergraphs, and selectively reduce acyclic hypergraphs. 
SI AM Journal on Computing, 13(3):566-579, 1984. 

32. E. Tsang. Foundations of Constraint Satisfaction. Academic Press, 1993. 

33. C. Terrioux and P. J'egou. Bounded Backtracking for the Valued Constraint Sat- 
isfaction Problems. In Proc. of CP'03, pp. 709-723, 2003. 

34. M. Yannakakis. Algorithms for acyclic database schemes. In Proc. of VLDB'81, 
pp. 82-94, 1981. 



15 



